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Abstract 

In this paper, we develop a two-stage distributed algorithm that enables nodes in a graph to 
cooperatively estimate the spectrum of a matrix W associated with the graph, which includes 
the adjacency and Laplacian matrices as special cases. In the first stage, the algorithm uses 
a discrete-time linear iteration and the Cayley-Hamilton theorem to convert the problem into 
one of solving a set of linear equations, where each equation is known to a node. In the second 
stage, if the nodes happen to know that W is cyclic, the algorithm uses a Lyapunov approach 
to asymptotically solve the equations with an exponential rate of convergence. If they do not 
know whether W is cyclic, the algorithm uses a random perturbation approach and a structural 
controllability result to approximately solve the equations with an error that can be made small. 
Finally, we provide simulation results that illustrate the algorithm. 


1 Introduction 

The spectrum of a graph, defined as the set of eigenvalues of either its adjacency or Laplacian 
matrix, provides a useful characterization of the properties of the graph. For instance, the distri¬ 
bution of such eigenvalues offers insights into the shapes and sizes of communities in a complex 
network [lj. As another example, the largest and smallest of such eigenvalues provides bounds 
on the maximum, minimum, and average node degrees [2], The spectrum has also been used, for 
example, in chemistry, where it is associated with the stability of molecules [2], and in quantum 
mechanics, where it is related to the energy of Hamiltonian systems [2j. 

With the continued advances in technology that enable humans to build increasingly complex 
networks, it is becoming desirable that nodes in a network have the ability to analyze the net¬ 
work themselves, such as decentralizedly computing the spectrum of the network, so that valuable 
understanding about, say, the network structure may be gained. Motivated by this, a number of 
‘This work was supported by the National Science Foundation under grant CMMI-0900806. 
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distributed algorithms have been proposed in the literature, including OMg that consider estima¬ 
tion of the entire spectrum of the Laplacian matrix, and M that focus on estimation of its second 
smallest eigenvalue (i.e., the algebraic connectivity). 

In this paper, we add to the literature by developing a two-stage distributed algorithm, which 
enables nodes in a graph to cooperatively estimate the spectrum of a matrix W associated with 
the graph. Unlike in M, the matrix W can be the adjacency or Laplacian matrix of the graph, 
a weighted version of these matrices, or any other matrix induced by the graph (see Section E|). 
To construct the algorithm, we first use a discrete-time linear iteration and the Cayley-Hamilton 
theorem to convert the original problem into an equivalent problem of solving a set of linear 
equations of the form Ax = b, where every row of A and b is known to a particular node (Section EJ). 
We then show that the matrix A can be made almost surely nonsingular if the nodes happen to 
know that W is cyclic, but not necessarily so if they do not (Section El). In the case of the former, 
we use a Lyapunov approach to asymptotically solve the equations with an exponential rate of 
convergence (Section E|). In the case of the latter, we use a random perturbation approach and a 
structural controllability result to approximately solve the equations with an error that can be made 
small (Section El)- Finally, we provide simulation results that illustrate our distributed algorithm 
(Section El) and conclude the paper with a word on future research directions (Section [7]). 

2 Problem Formulation 

Consider a network modeled as an undirected, connected graph Q = (V, £), where V = 
{1,2,... ,N} denotes the set of N > 2 nodes and £ C {{i,j} ■ i,j € V ,i / j} denotes the set 
of edges. Any two nodes i,j € V are neighbors and can communicate if and only if {i,j} € £■ The 
set of neighbors of each node i G Vis denoted as J\f t = {j E V : {i, j} E £}, and the communications 
are assumed to be delay- and error-free, with no quantization. 

Suppose associated with the graph Q is a square matrix W = [w l3 \ E M JVxAr satisfying the 
following assumption: 

Assumption 1. The matrix W is such that for each i,j E V with i ^ j, if {i,j} £ £, then 

Wij = wji = 0 . 

Note that Assumption [1] allows wa Vi E V to be arbitrary. It also allows and Wji V{i,j} E £ 
to be arbitrary and different. Thus, W can be the adjacency or Laplacian matrix of graph Q, a 
weighted version of these matrices, or any other matrix associated with Q as long as Assumption |T] 
holds. 

Suppose each node i E V knows only A/), wa, and Wij Vj E A/), which it prefers to not share with 
any of its neighbors due perhaps to security and privacy reasons. Yet, despite having only such 
local information about the graph Q and matrix W, suppose every node i E V wants to determine 
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the spectrum of W, i.e., all the N eigenvalues of W, denoted as 

A (1) ,A (2) ,...,A (a ° € C, (1) 

where complex eigenvalues must be in the form of conjugate pairs. Finally, suppose each node 
i £ V knows the value of N, which is not an unreasonable assumption since each of them wants to 
determine the values of N objects. 

Given the above, the goal of this paper is to devise a distributed algorithm that enables every 
node i £ V to estimate the spectrum 0 of W with a guaranteed accuracy. 


3 Forming a Set of Linear Equations 


In this section, we show that by having the nodes execute a discrete-time linear iteration N 
times, the problem of finding the spectrum m of W may be converted into one of solving a set of 
linear equations with appealing properties. 

Observe that although none of the nodes has complete information about Q and W, each node 
i £ V knows the entire row i of W (since it knows wa and Vj £ Mi, and since Wij = 0 
Vj ^ {i} U Mi by Assumption 0. This makes the nodes well-suited to carry out the discrete-time 
linear iteration 

Uiit + 1) = wuyi(t ) + ^2 w ijyj(t )> Vz € V, Vi £ Z + , (2) 

jeM 

which in matrix form may be written as 


y(t + 1) = Wy{t), Vi £ Z+, 


(3) 


where 


{0, 1 , 2 ,.. .}, yi(t) £ R is maintained in node z’s local memory, and 


y(t) = yi(t) 2/2(i) 


yjv(t) 


l T 


t,N 


(4) 


Indeed, © or (0 can be implemented by having each node i £ V repeatedly send its yi{i) to every 
neighbor j € Mi- 

Since 0 is a discrete-time linear system, we can write 


y(t) = W t y{ 0), Vi£ Z+, 


(5) 


so that 


y(N) = W N y{ 0). 


By the Cayley-Hamilton theorem, W N in 0 may be expressed as 


W N = -x (0) I N - x (1) W - x^-^W 1 *- 1 , 


( 6 ) 

(7) 
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where I n £ M nxri is the identity matrix and the scalars x^,x ^,... ,x^ N ^ gR are the N coeffi¬ 
cients of the characteristic polynomial of W, i.e., 


det(A I N - W) = (A - A^)(A - A< 2) ) • • • (A - A^) 

= A^ + X ( N - 1) \ N ~ 1 + ■ ■ ■ + x (1) A + x (0) . (8) 


Substituting © into © and using (|5|), we obtain 

y{N) = (- X {0) I N - x^W - x^-^W^MO) 

= —x^y( 0) — x^y(l) — • • • — x^ N ^ 1 ' > y(N — 1). (9) 

By using ©, we can rewrite © as 


2/1 (0) 2/1 (1) • 
2/2(0) 2/2(1) • 

• 2/1 (N - 1 )' 

• y2(N-l) 


' x (0) ' 

X^ 


' -2/1W 
-2/2 (iV) 

_ 2 /Jv( 0 ) 2 Mr(l) • 

■ y N (N - 1 )_ 


X {N-1) 


- 2 Jn(N)_ 


A x* b 


where, for later convenience, we denote the matrix on the left-hand side of (1101) as A £ R NxN , the 
vector of characteristic polynomial coefficients as x* £ M N , and the vector on the right-hand side 
of m as b £ R N . 

The matrix equation (1101) suggests the following approach for finding the spectrum © of 
W: suppose each node i £ V selects an initial condition yi(0) £ M. Upon selecting the ?/j(0)’s, 
suppose the nodes execute the discrete-time linear iteration © or equivalently © N times for 
t £ {0,1,... , N — 1}. During the execution, suppose each node i £ V stores the resulting N + 1 
numbers 2/i(0), 2/i(l)>..., yi(N — 1), yt(N) in its local memory. Then, (flOl) is a set of N linear equa¬ 
tions in which each node i £ V knows the entire row i of A and b, and in which the vector x* of 
N characteristic polynomial coefficients x(°),xW,... of W are the N unknowns. It follows 

that if A is nonsingular, and if the nodes are able to cooperatively solve m for the unique x*, 
then each of them could determine on its own the N eigenvalues A^ 1 ), A^ 2 ),..., A^ of W using © 
and a polynomial root-finding algorithm. 

To realize the above approach, it is necessary that A in (HOD is nonsingular. To see whether this 
can be ensured, observe from ©, ©, and (fTOl) that A may be expressed as 


A = 


2/(0) Wy{ 0) ••• W N ~ 1 y(0) 


( 11 ) 


In the form m, A is, interestingly, the controllability matrix of a fictitious discrete-time single¬ 
input linear system 


z(t + 1) = Wz(t) + y(0)u(t), Vi £ Z. 


( 12 ) 
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where z(t) £ is its state, u(t) £ R is its input, W is its state matrix, and y(0) is its input 
matrix. Hence: 

Proposition 1. The matrix A in cnD or m is nonsingular if and only if the pair (W,y( 0)) of 
the system (ED is controllable. 

Since W is given by the problem but y(0) may be freely selected by the nodes, it may be possible 
to select y( 0) so that the pair (W, y( 0)) is controllable. The following definition and lemmas examine 
this possibility: 

Definition 1 (|9j). A square matrix with real entries is said to be cyclic if each of its distinct 
eigenvalues has a geometric multiplicity of 1. 

Lemma 1. IfW is not cyclic, then for every y( 0) £ , the pair (W,y(0)) is not controllable. 

Proof. Suppose W is not cyclic and let y{ 0) £ be given. Then, by Definition [1] W has an 
eigenvalue A £ C whose geometric multiplicity exceeds 1, i.e., rank(W — XIn) < N — 1. Since 
y( 0) is a column vector, rank([TT — A In | 2/(0)]) < N. Therefore, by statements (i) and (iv) of 
Theorem 3.1 in [9], the pair (W, y(0)) is not controllable. □ 

Lemma 2. If W is cyclic, then for almost every y( 0) € R N , the pair (W, y(0)) is controllable. 

Proof. According to Lemma 3.12 in [9], if A £ R nxn is cyclic and B £ R raxm is such that the pair 
(A, B) is controllable, then for almost every v £ R m , the pair (A. Bv) is controllable. Applying this 
lemma with A = W, B = In, and v = y( 0), and using the fact that the pair (W, In) is controllable, 
we conclude that so is the pair (W,y(D)). □ 

Proposition |T| and Lemma |T] imply that W being cyclic is necessary for A in (HOD or m to 
be nonsingular. Lemma© on the other hand, implies that W being cyclic is essentially sufficient 
because almost every y{ 0) £ M. N would work. This latter result is especially useful in a decentralized 
network because the result allows each node i £ V to select its yi{ 0) £ R independently from other 
nodes and randomly from any continuous probability distribution before executing © or Q, and 
be almost sure that the resulting A would be nonsingular. 

Motivated by the above analysis, in the rest of this paper we consider separately the following 
two scenarios: 

Scenario 1. The nodes know that W is cyclic. 

Scenario 2. The nodes do not know whether W is cyclic, or know that W is not cyclic. 

We consider Scenarios |T] and [2] separately because Scenario Q] is easier to deal with (in Section © 
and its treatment helps us deal with Scenario [2] (in Section©. We note that both of these scenarios 
arise in applications. For instance, if the graph Q represents a sensor network and the entries wa 
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Vi £ V and Wij V{i, j} £ £ of TV represent random sensor measurements with continuous probability 
distributions, then Scenario Q] takes place as the nodes could say with near certainty that W is cyclic 
because almost every n-by-n matrix has n distinct eigenvalues and, thus, is cyclic. In contrast, if 
W represents the adjacency or Laplacian matrix of Q , then Scenario [2] takes place as W would be 
cyclic if Q is, say, a path graph [2] and would not be cyclic if Q is, say, a complete or cycle graph [2], 
which the nodes could not tell because they only have local information about Q. 

To summarize, in this section we have transformed the problem of finding the spectrum (jT]) of 
W into one of solving the set of linear equations (HOD , in which each node i £ V knows the entire 
row i of A and b, and in which A can be made almost surely nonsingular in Scenario [TJ but not 
necessarily so in Scenario [2j 


4 Solving the Set of Linear Equations in Scenario [T] 

In this section, we focus on Scenario [1] and develop a continuous-time distributed algorithm 
that enables the nodes to asymptotically solve the set of linear equations (11011 with an exponential 
rate of convergence. 

To facilitate the development, we assume that the nodes have executed © or © to arrive 

at m■ Moreover, since A in (1101) can be made almost surely nonsingular in this Scenario |T] we 

assume that it is nonsingular throughout the section. With these assumptions, for each i £ V let 

l T 


CLi — 


Vi{ 0) Vi{ 1) 


yi(N - 1) £ M. N and bi = ~Vi{N) £ R, so that m may be stated as 


r t i 

~a\ 


x (°) 


~bi 

T 

-at 2 - 


j,! 1 ) 

— 

b 2 

1 

© 

** 

1_ 


x ( N ~i) 


pN_ 


(13) 


where a* and bi are known to node i because © or © has been executed. In addition to 
knowing a* and bi, suppose each node i £ V maintains in its local memory an estimate Xi(t) = 

of the unknown, unique solution x* £ , where here 


„( 0 ) 


{t) Zi 1} (t) 


4 N 1} w 


t £ [0, oo) denotes continuous-time (unlike in Section E] where t € Z + denotes discrete-time). Fur¬ 
thermore, let x(f) = (xi(t), X 2 (t),... , xjv(t)) € and x* = (x*, x *,..., x*) € be vectors 
obtained by stacking the N estimates Xi(ty s and N copies of the solution x*. 

To come up with a distributed algorithm that gradually drives x(t) to x*, consider a quadratic 
Lyapunov function candidate V : l^ 2 —>• R, defined as 


y ( x ) =J2 ai ( a i 


Xi - 


iev 


bi) 2 + ^2 ^ i jy(x i -x j ) T (x i -Xj), 
{hi}e£ 


(14) 


6 














where a* > 0 V?' £ V and fiu,p. > 0 V{i,j} £ £ are parameters. Notice that each term in the 
first summation in m is a measure of how far away from the hyperplane {z £ M. N : ajz = bi} 
the estimate Xi(t) is. Moreover, because A is nonsingular and because of (fl3l) . the N hyperplanes 
{z £ M. n : ajz = bi } Vi £ V have a unique intersection at x*. Furthermore, the second summation 
in (1141) is a measure of the disagreement among the estimates Xi(t)’s. Hence, both the first and 
second summations in (1141) are only positive semidefinite functions of x. However, as the following 
proposition shows, adding them up makes V a legitimate Lyapunov function candidate: 

Proposition 2. If A in m is nonsingular, then the function V in Cl is positive definite with 
respect to x*. 


Proof. Clearly, V is a positive semidefinite function of x. To show that it is positive definite with 
respect to x*, we show that V (x) = 0 if and only if x = x*. Suppose x = x*. Then, ajxi — bi = 0 
Vi £ V according to (fT3l) . In addition, the second summation in (fTTl) drops out. Therefore, 
H(x) = 0. Next, suppose P(x) = 0. Then, 

ajxi = bi, Vi £ V, (15) 

x% — Xj , V{i,j} £ £. (16) 

Since Q is connected, (fl6l) implies that there exists x £ such that Xi = x Vi € V. Substituting 
this into m, we get aj x = bi Vi £ V or, equivalently, Ax = b. Since A is nonsingular, we have 
x = x*, so that x = x*. □ 


Remark 1. Notice that V in (1141) can also be written as 


V(x) = (x-x*) T P(x-x*), 


where P 


P T £ ]^ N2xN2 ig positive definite and given by 


P = 


aqaiaq 




0 


+ L/3 (g) /tv , 


0 


OtNClNaJf, 


where <g> denotes the Kronecker product and Lp = [Ljj] £ M jVxiV is a weighted Laplacian matrix of 
Q with La = L v = if {*> j} G ^ > and L ij = 0 if i^j and {i,j} ££. □ 

With Proposition [2] in hand, we next take the time derivative of V along the state trajectory 
x(t) to obtain 


H(x(f)) =2^[, 
iev 


ai(afxi(t ) - bi)ai + ^ P{i,j}{xi{t) - Xj(t )) ±i(t), Vt £ [0,oo). (17) 

jetfi 
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Examining (11711 . we see that V(x(t)) can be made negative semidefinite—at the very least—by 
letting each Xi(t) be the negative of the expression within the brackets in (|17l) . i.e., 

Xi(t) = -ai(afxi(t) - bi)ai - ^2 P{i,j}( x i(t) - x j( t ))> V* £V, Mt £ [0, oo). (18) 

j&Mi 

The following theorem asserts that the continuous-time system (1181) possesses an excellent property: 

Theorem 1. If A in (Hsu is nonsingular, then the system (fT8l) has a unique equilibrium point at x* 
that is globally exponentially stable, so thatMx( 0) £ lim^oo x(i) = x*, i.e., lim^oo Xi(t) = x* 
Mi £ V. 


Proof. For each i £ V, setting Xi(t) in (fT8l) to zero yields 

0 = -aciiafxi - bf)ai - ^ P{i,j}( x i - x j)- (19) 

j&K 

Summing both sides of (1191) over i £ V gives 

0 = ^2 ~ a i( a I x i - bi)ai. ( 20 ) 

iev 

Due to (fl3l) and to A being nonsingular, the vectors a\, 02 ,..., ajy in (1201) are linearly independent 
in R. N . Thus, 


0 = —ai(ajxi — bi), Mi € V. 


( 21 ) 


Substituting (12T1) back into (fl9l) results in 


which is equivalent to 


0 = 22 _ 

jeAfi 


Mi € V, 


0 = (Lp <g> /jv)x, (22) 

where <8> and Lp have been defined in Remark [T] Since Q is connected, (1221) implies that Xj = x 
Vi € V for some x € M. N . Plugging this into (12TT) yields af x = bi Mi £ V. Since A is nonsingular, 
we have x = x*, i.e., x = x*. Hence, the system (1181) has a unique equilibrium point at x*. Since 
for each i £ V the right-hand side of (1181) is the negative of the expression within the brackets in 
(fTTD . V{x.(t)) is negative definite with respect to x*. Therefore, the equilibrium point x* is globally 
exponentially stable. □ 

Having established Theorem [Q we now relate it back to the original problem of finding the 
spectrum m of W. To this end, suppose each node i £ V maintains in its local memory an 
estimate A f\t) £ C of the unknown, Mi eigenvalue A^ of W for £ £ {1,2,..., N}. Also suppose 


at each time t £ [0, oo), node i lets its N estimates A^(t)’s be the roots of an Ath-order polynomial 

T 


formed by the estimate Xi(t) = x- u (t) (t) 

memory, i.e., 


4 N -\t) 


that is also stored in its local 


(A -Af’MKA-AfW)--- (A -><">(()) 

— + a: ! - Ar-1 ^(i)A Af_1 -f-AaP(£)A + 4°A) Vi e V, Vt £ [0,oo), (23) 


which can be implemented using a polynomial root-finding algorithm embedded in node i. Then, 
because (A^, ..., A (Ar () in © is a continuous function of x*, and (A^(i), A- 2 ^(f),... , 

in (1231) is the same continuous function of x t (t) , Theorem (T] implies that 

lim A, W (t) = A W , VieV, We{l,2,...,IV}. (24) 

t —AOO 

Equation (1241) , in turn, implies that the system (1181) is a continuous-time distributed algorithm that 
enables the nodes to asymptotically learn the spectrum JT]) of W. 

Putting together the development in Sections [3] and 21 we obtain the following two-stage dis¬ 
tributed algorithm, which is applicable to this Scenario [l] 

Algorithm 1 (For Scenario [TJ. 

1. Each node * € V selects its yi{ 0) G R independently from other nodes and randomly from any 
continuous probability distribution. 

2. Upon completion, the nodes execute Q or ([3]) N times for t e {0,1,... , N — 1}, so that each 
node i £ V gradually learns the entire row i of A and b in ( 1101 ) . 

3. Upon completion, the nodes execute (fl8l) and (1231) for t £ [0, oo), so that each node i £ V is 

able to continuously update its Xi(t) and A^(t)’s. ■ 

Remark 2. The current literature offers a few distributed algorithms mm that may be used to 
solve linear equations (HOD . These algorithms are different from (j 18 1) in that they force the state of 
each node to stay in an affine set, whereas (1181) allows the state to freely roam the state space. □ 


5 Solving the Set of Linear Equations in Scenario [2] 

In this section, we focus on Scenario [2] and provide a slightly different algorithm that enables 
the nodes to approximately solve (HOD with an error that can be made small. 

Recall that Scenario [2] represents a situation where the nodes either do not know whether W is 
cyclic, or somehow know that W is not cyclic. Consequently, they either do not know whether A in 
(HOD is nonsingular, or know that A is singular. Although the nodes could still apply Algorithm [L] 
there is no guarantee that their estimates Xi(t ) : s would converge to x*. One way to address this 
issue is to have the nodes randomly perturb the matrix W and vector y(0), so that the resulting 
A in (ED is hopefully nonsingular. Of course, such a random perturbation approach no longer 
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allows them to asymptotically determine the exact spectrum of W. However, getting an estimate 
of the spectrum of IT may be sufficient in some applications. Thus, we will adopt this random 
perturbation approach in this Scenario [2j 

For notational simplicity, let the matrix associated with the graph Q be denoted as IT = [uJy] £ 
R NxN i ns t ea d of W = [Wij ], and let W instead denote a perturbed version of W. In addition, let 
af^’s and A^’s denote, respectively, the characteristic polynomial coefficients and eigenvalues of IT 
that the nodes wish to determine, and let x^’s and A^’s denote those of IT as before. Moreover, 
let the perturbed matrix IT be obtained from IT in a decentralized manner as follows: prior to 
executing @ or @, each node i £ V lets 

vju = wu + 5u, Vi £ V, (25) 

= Wij + Sij, Vi £ V, Vj £ J\fi, (26) 

where the 6a ’s and d^’s are independent, uniformly distributed random variables in the interval 
[—a, a], so that a > 0 represents the perturbation magnitude. Notice that since Wij = 0 Vi £ V 
Vj ^ {i} UAfi by Assumption [U 

w^ = 0, Vi £ V, Vj ^ {i} U Mi (27) 

as well. Also note that because the nodes are slated to select their yfi 0)’s independently and 
randomly from a continuous probability distribution, there is no need to further randomly perturb 
these 2 /j( 0 )’s. 

The following lemma uses a structural controllability result to show that the aforementioned 
approach is effective: 

Lemma 3. If W is as defined in (1251) ~ ([27l) and y(0) is as defined in Step 1 of Algorithm QJ then 
A in an is almost surely nonsingular. 

Proof. Reconsider the graph Q = (V,£) from Section 0 Let S = {(A,B) € R NxN x R N : Aij = 
0 if i j and {i, j} ^ £} and S c = {(A,B) £ S : ( A,B ) is controllable} C S. In addition, 
let A* = diag(l, 2,... , N) £ R NxN and B* £ R N be the all-one vector. Then, (A*,B*) £ S 
according to the definition of S. Moreover, (A*,B*) £ S c because the controllability matrix formed 
by (A*,B*) is a Vandermonde matrix that is nonsingular. These two properties of (A*,B*), along 
with the definition of structural controllability [12j, imply that every (A,B) £ S is structurally 
controllable. Next, let ( A,B) £ S and e > 0 be given. Then, by Proposition 1 of [T2], there exists 
(Ac, B c ) £ <S C such that ||^4 — A c \\ < e and \\B — B c \\ < e. Hence, S c is a dense subset of S. Lastly, 
note that (IT, y(0)) £ S due to Assumption [Q ([25]) - (1271) . and Step 1 of Algorithm |TJ Since S c is a 
dense subset of S, (IT, y(0)) is almost surely in S c . Therefore, by Proposition [Q A in (fill) is almost 
surely nonsingular. □ 
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As it follows from Lemma [3j by having the nodes perform the extra step described in (12511 
fl27D , the results developed in Sections [3] and [4] become applicable to this Scenario 0 Furthermore, 
because both the characteristic polynomial coefficients and eigenvalues of a matrix are continuous 
functions of its entries, by having the nodes decrease the perturbation magnitude a toward zero, the 
differences between the x^’s and A^’s of W and the x^'s and A^’s of W can be made arbitrarily 
small, at least in principle. Note, however, that numerical issues may arise when a is too small, 
or when the resulting A is ill-conditioned. At present, we do not have answers to these numerical 
issues, and we believe they are important future research directions. 

Based on the above, we obtain the following two-stage distributed algorithm for this Scenario [21 

Algorithm 2 (For Scenario [21) • 

1. Each node i £ V executes (|25j) - (1271) to obtain a perturbed matrix W. 

2. The remaining steps are identical to those of Algorithm [TJ ■ 

6 Simulation Results 

In this section, we present two sets of simulation results that demonstrate the effectiveness of 
Algorithm [T| for Scenario |T| and Algorithm [2] for Scenario [21 

6.1 Simulation of Algorithm [T] for Scenario [1] 

Consider a sensor network with N = 6 nodes, modeled as an undirected, connected graph Q, 
whose topology is shown in Figure QJa). Suppose associated with the graph Q is a 6-by-6 matrix 
W, whose entries satisfy Assumption Q] and represent random sensor measurements given by 


-0.10 

-0.24 

0 

0.78 

0 

0 

0.24 

0.53 

0.39 

-0.04 

0 

-0.19 

0 

0.34 

0.21 

1.15 

-0.13 

0.71 

-0.26 

-0.21 

0.32 

-0.54 

0 

0 

0 

0 

-0.45 

0 

0.39 

0 

0 

0.47 

-0.84 

0 

0 

-1.35 


Assuming that such measurements are realizations of continuously distributed random variables, 
the nodes are almost certain that W is cyclic, so that Scenario [T] takes place. Thus, to determine 
all the eigenvalues A^’s of W, which are given by —1.02 ± 0.551, —0.004 ± 0.461. 0.38, and 0.81, 
the nodes may apply Algorithm [I] 

Figures [D(b)-[Hd) display the result of simulating Algorithm |T] with = 10 Vi G V and 
P{ij\ = 10 V{i,j} £ £. Specifically, Figure QJb) shows the data points yi(t) for i £ {1,2,... ,6} 
and t £ {0,1,... , 6} that are used to form the set of linear equations (flOl) . Figure [Q(c) shows, as a 
function of time t, node 3’s estimate x^\t) of the £th characteristic polynomial coefficient of 
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(a) A 6-node graph. 




Time t 

(b) Data points yi(t) for i € {1,2, ...,6} and t € 
{0, 1,..., 6} that form the set of linear equations (11011 . 



(c) Node 3’s estimate x^\t) of the 7th characteristic (d) Node i’s estimate x^\t) of the 1st characteristic 
polynomial coefficient x^ for £ € {0,1,..., 5}. polynomial coefficient oA 1 -* for * € {1,2,..., 6}. 


Figure 1: Performance of Algorithm |T| for Scenario [IJ 


W for £ E {0,1,... , 5}. Likewise, Figure QJd) shows node z’s estimate xf\t) of the 1st coefficient 
for i € {1,2,... ,6}. (Due to space limitation, we are unable to include plots of xf\t) for all 
* £ {1, 2,... , 6} and l £ {0,1,... , 5}.) Observe that despite having only local information about Q 
and W, the nodes are able to utilize Algorithm [T| to asymptotically determine all the characteristic 
polynomial coefficients x^’s of W and, hence, all its eigenvalues A^’s. 


6.2 Simulation of Algorithm [2] for Scenario [2] 

Consider next an undirected, connected graph Q with N = 6 nodes, whose topology is shown in 

Figure [2]Ja). Let W represent the adjacency matrix of Q and suppose the nodes wish to determine 

— m — 

all the eigenvalues A ’s of W, which are given by —1.73, —1, —1, —0.41, 1.73, and 2.41. Because 
they only have local information about Q, the nodes do not know whether W is cyclic, so that 
Scenario [2] takes place. (In fact, W in this particular example is not cyclic because it is symmetric 
and has repeated eigenvalues, at —1.) Therefore, the nodes have to apply Algorithm [2j In doing 
so, they let the perturbation magnitude be a = 0.2 and obtain from (1251) (1271) a perturbed matrix 
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(a) A 6-node graph. 



0 100 200 300 400 

Time t 

(c) Node 2’s estimate x%\t) of the £th perturbed and 
true characteristic polynomial coefficients x ^ and 
for £ £ {0,1,..., 5}. 



Time t 


(b) Data points yi(t) for i £ {1,2, ...,6} and t £ 
{0, 1,..., 6} that form the set of linear equations (11011 . 



(o\ 

(d) Node i’s estimate x\ (t) of the 2nd perturbed and 
true characteristic polynomial coefficients x ® and 
for i £ {1,2,..., 6}. 


Figure 2: Performance of Algorithm [2] for Scenario [3 


W given by 
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0.98 
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1.06 

0 
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0.95 

1.01 

0 

0 
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0.98 
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1.01 

0.97 

0 

0 

0 

0.92 
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whose eigenvalues A^’s are —1.74, —0.97, —1.03, —0.40, 1.73, and 2.43, which are all distinct and 
slightly different from the eigenvalues A s of W. 

Figures [3(b)-[3(d) display the result of simulating Algorithm [2] with ct* = 100 Vi G V and 
P{ij\ = 10 V{z,j} € £, using a format similar to that of Figures [Ub)-[jjd). The only difference 
is that Figures [3c) and[2|d) show not only the characteristic polynomial coefficients x^’s of the 
“perturbed” W, but also the characteristic polynomial coefficients x^’s of the “true” W. Observe 
that with Algorithm [3 the nodes are able to asymptotically determine the x^’s and A^’s. In 
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other words, they are able to approximately calculate the x^’s and A^’s with small errors. 

7 Conclusion 

In this paper, we have designed and analyzed a two-stage distributed algorithm that enables 
nodes in a graph to cooperatively estimate the graph spectrum. We have shown that asymptotically 
accurate estimation can be achieved if the nodes know that the associated matrix is cyclic, and 
estimation with small errors can be achieved if they do not. As for future research, we believe that 
making the algorithm numerically more robust, so that it can cope with poorly conditioned W and 
A, is an important next step. 
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